CLASSICAL MARKOVIAN KINETIC EQUATIONS: EXPLICIT 

FORM AND H-THEOREM 

Constantinos Tzanakis 
University of Crete, 74100 Rethymnon, Crete, Greece 

Alkis P. GrecosQ 
Service de Physique Statistique et plasmas 
Universite Libre de Bruxelles, Campus Plaine (CP.231) 
1050 Bruxelles, Belgium 

Abstract 

The probabilistic description of finite classical systems often leads to linear kinetic equations. A 
set of physically motivated mathematical requirements is accordingly formulated. We show that it 
necessarily implies that solutions of such a kinetic equation in the Heisenberg representation, define 
Markov semigroups on the space of observables. Moreover, a general _£/-theorem for the adjoint of such 
semigroups is formulated and proved provided that at least locally, an invariant measure exists. Under a 
certain continuity assumption, the Markov semigroup property is sufficient for a linear kinetic equation 
to be a second order differential equation with nonegative-definite leading coefficient. Conversely it is 
shown that such equations define Markov semigroups satisfying an 7Z-theorem, provided there exists 
a nonnegative equilibrium solution for their formal adjoint, vanishing at infinity. 

1. INTRODUCTION 

In a probabilistic description of classical systems with a finite number of degrees of 
freedom, one often encounters linear, autonomous, evolution equations of the form 

^ = Z s f. (1.1) 
dt bJ K J 

Such equations, which henceforth, and for the sake of brevity, will be called kinetic 
equations, are assumed to determine the time evolution of the statistical state of the 
system. In this context, states are taken to be probability densities on the phase space, 
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the manifold of the dynamical variables characterizing the system, while observables 
A are simply (sufficiently well-behaved, real) phase-space functions. Furthermore, ex- 
pectation values are obtained via some bilinear form w on the cartesian product of the 
spaces of states and observables 

(A)j = w(f, A), (1.2) 

provided they remain finite for all observables, i.e. |tu| < +00. If the evolution of 
observables is considered, an equation of the form 

f)A 

« = zoa, (i.n 

should hold, with Z Q a formal adjoint in the sense that 

w(f,Z A) = w(Z s f,A) (1.3) 

Here it is being assumed that w separates the states and observables (equivalently: w 
is nondegenerate) and 

w(f t ,A)=w(f,A t ) 

i.e. the two pictures are essentially equivalent. Typical examples are well known kinetic 
equations, like those of Kramers, Fokker-Planck or the (linear) Boltzmann and Landau 
equations 1-3 . Such equations result by applying some more or less systematic approx- 
imation scheme based on a perturbation analysis of the exact microscopic dynamics 
of the system under consideration 3 ' 4 , or by applying stochastic methods 2,5 , based on 
assumptions concerning the behaviour of a large number of microscopic events charac- 
terizing the system. For classical open systems weakly interacting with large equilibrium 
baths, kinetic equations have been derived 6 ' 7 using techniques similar to those devel- 
opped for quantum systems 8 . On the other hand, some 'markovianization' procedures 
imposed on the exact dynamics may lead to inconsistent equations 9 . Note that in such 
derivations, expansions with respect to some appropriate parameter are used, implying 
that Zs or Zo are differential operators of some order, depending on the approximation. 

However in the physics litterature, not sufficient attention has been given to a general 
presentation of the structure and properties of such classical ( "Markovian" ) kinetic 
equations, independently of the method used to derive them 10 . In our opinion this seems 
necessary at least for two reasons : 
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(a) as already mentioned, proposed perturbation schemes may lead to results incom- 
patible with a probabilistic interpretation, particularly, violation of positivity of the 

states 9 

(b) derivations based on the theory of stochastic processes a priori impose conditions 
on the physical characteristics of the systems studied (e.g. postulate a master evolution 
equation for the states, like the Chapman-Kolmogorov equation, on which approxima- 
tions are subsequently made). 

Instead, our aim in this paper is to provide a mathematically rigorous and physically 
adequate framework for the study of such kinetic equations, and examine certain of 
the properties of their solutions, formally determined by one parameter semigroups 
V t = e Zst . Specifically, we give minimal conditions under which 

(1) Eq. (1.1) does indeed define rigorously a semigroup of solutions capable of a prob- 
abilistic interpretation, particularly preserving positivity, 

(2) it is possible to characterize Z$ and Zq and explicit their general form if they are 
differential operators, 

(3) an H-theorem for arbitrary continuous convex functionals of the state can be 
proved. 

In this way, the outline of the formal framework for a probabilistic description of finite 
classical systems given at the beginning of this section, is made precise and kinetic 
equations like (1.1), (1-1') become in principle mathematically and physically mean- 
ingful. Our approach is similar to that followed in defining dynamical semigroups for 
quantum systems 11 . To this end, we notice that (1.2) is essentially a duality relation, 
suggesting that states are linear functionals defined on observables. Then the interpre- 
tation of states as probability densities in (1.1) implies that observables are bounded 
functions in phase-space. Then, in view of (1.2), finite expectation values for all observ- 
ables naturally leads to an extension of the state-space beyond probability densities, 
so that all linear functionals defined on bounded functions are included. In section 2, 
these qualitative remarks are precisely formulated, thus establishing a sufficiently wide 
mathematical framework for the derivation of rigorous results. In particular it will be 
seen that kinetic equations like (1.1' ) should necessarily define a Markov semigroup of 
solutions on the (Banach) space of observables. In section 3 we collect basic theorems 
concerning the generator of a Markov semigroup. Some proofs are presented, mainly 
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because they are partly used as intermediate steps toward other results so that the 
paper is sufficiently self-contained. In section 4 we show rigorously that the only differ- 
ential operators that are candidates as generators of Markov semigroups, are at most 
of the 2nd order, namely (degenerate in general) elliptic operators (Lemma 4.1). We 
further supply a complete proof of the fact that under a certain continuity assumption, 
well-known in the theory of stochastic processes, eq(4.1), the generator of a Markov 
semigroup is indeed a differential operator (theorem (4.1)). The converse problem is 
considered in section 5, where we show that under mild regularity conditions, in general 
degenerate elliptic operators generate Markov semigroups globally defined on the space 
of observables. This generalizes classical results on local solutions of nondegenerate 
elliptic equations. Finally in section 6, a general H-theorem for arbitrary continuous 
junctionals on the state-space is formulated and proved for any (and not only for a 
diffusion type) Markov semigroup, under the assumption that an invariant measure ex- 
ists, which for a diffusion-type semigroup is implied by the existence of an equilibrium 
solution p of (1.1) (theorem 6.1). It should be emphasized at this point that po need 
not be a probability density, i.e. integrable on the whole phase-space of the system (e.g. 
for particle systems, in position as well as in velocity space). This is a global formu- 
lation of the H-theorem (corollary (6.1)) to be contrasted to the local one given as an 
entropy continuity equation, and usually obtained in cases the kinetic equation for the 
states has a nonintegrable stationary solution. Moreover, it will become apparent that 
the existence of such a solution (satisfied by the formalism of Refs.6, 7) implies that 
the Markov semigroup property (specifically, positivity conservation) is (essentially) 
equivalent to the existence of H-functions. 



2. MATHEMATICAL ASSUMPTIONS AND THEIR 
PHYSICAL MOTIVATION: MARKOV SEMIGROUPS 



As already mentioned, inherent to kinetic equations like (1.1) is a probabilistic interpre- 
tation. Motivated by the preceding qualitative discussion, we introduce a minimal set of 
assumptions to fix an appropriate mathematical framework for states and observables 
of a finite classical system and for their time evolution given by kinetic equations like 
(1.1), (1.1')- Though the interpretation of states is better suited to supply the physical 
motivation for such assumptions, it is mathematically more convenient to work with 
observables. This is suggested by theorem 2.1 below and will become more evident in 
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sections 3-5. The results thus obtained will enable us to return to the state space when 
formulating and proving the H-theorem in the last section. 

We consider admissible observable quantities A as (real) bounded continuous func- 
tions on the phase space X, that remain finite at infinity, X being a differentiate 
manifold (e.g. the phase-space of a Hamiltonian system). It is convenient to embed 
them in a complex linear space (and extend w in (1.2) to a sesquilinear form). Thus 
we introduce 

Assumption (Ai) : The phase-space X of a system is a differentiable manifold, and 
observables belong to C(X QO , C), the space of all continuous complex valued functions 
having a finite limit at infinity. 

Here, X^ is X together with the infinite point (more precisely, the one-point com- 
pactification of X). Then continuous functions A, having a finite limit at infinity (in 
particular constant functions) 12 can be identified with continuous functions on X^, by 
defining A{po) to be this finite limit. Thus observables belong to C(X OQ , C) which is a 
Banach space with norm \ \A\ \ = swp xeX \A(x)\. 

In section 1, it has been suggested that states / are linear functionals on the space 
of observables, their values 1(A) giving expectations. Then, their probabilistic interpre- 
tation requires them to be positive, i.e. 1(A) > for A > 0, since expectation values 
of nonegative random variables are nonegative (notice that I is real in this case). Then 
I is bounded with bound ||/|| = 1(1) 13 , hence I is continuous on C(X OQ ,G) that is 
/ G C*(X oa , C) where S* is the Banach dual of a normed space S. The above comments 
are summarized in 

Assumption (A 2 ) : If C(X OQ , C) contains the observables A, then states / are positive 
linear functionals on it and expectation values are given by 1(A). 

We remark here, that states thus introduced, extend the class of states defined by 
probability densities, this extended class being characterized as probability measures 
by the Riesz-Markov theorem below 13,14 . 

Theorem 2.1 (i) For every positive £ G C*(X OQ ,G) there exists a unique positive 
(regular) Borel measure \i such that 

1(A) = J A(x)d l x(x) , ||l|| = £(l) = /ipU (2.1) 

(ii) More generally, if £ G C*(X oc , (D), there exists a unique complex Borel measure \x 
such that (2.1) holds and ||£|| = IfiKX^), where is the total variation of /i 14 . 
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Remarks: In the present work all measures are regular Borel measures. The theorem is 
valid if C{X 00) C) is replaced by Co(X, C) or C C (X, (D), the spaces of functions vanishing 
at infinity or having compact support respectively. Finally, we notice that unbounded 
phase space functions such as polynomials, have been excluded from observables, since 
for such functions it is impossible to have finite expectation values for all states. 

Having established states and observables as elements of dual Banach spaces, we 
introduce for their time evolution (1.1), (1-1') 

Assumption (A 3 ): Equation (1.1') has a well-posed initial-value problem, that is: for 
given initial data, the solution is unique for t > 0, it depends continuously on the initial 
data (small changes in the initial data imply small changes in the solution, in the sense 
of the Banach space norm) and expectations are continuous in t. 

Notice that A 3 , proposition 2.2 below and A 2 imply that A 3 holds for (1.1) as well and 
by the linearity of (1.1') nonuniqueness for one initial condition implies nonuniqueness 
for all. It is well known that A 3 implies 

Proposition 2.1 If (1.1') is linear, autonomous and has a well-posed initial value 
problem on some set U of the Banach space of observables, then its solutions A(t) 
with initial conditions A, uniquely define a s-continuous one-parameter semigroup of 
operators T t A = A(t) on the Banach subspace B = U (from now on the prefix s or w 
means strong or weak respectively and U is the s-closure of U). 

Here we used that continuity of expectation values imply w-continuity of T t for t — 0, 
which is equivalent to its s-continuity for t > 15 and 

Definition 2.1 A (one-parameter s-continuous) semigroup (of operators) on a Banach 
space B, is a family of bounded linear operators { T t , t > }, such that: 
(i) T t+S = T t T s , (ii) s-linif-^ T t A — T to A WAeB, 

Its generator Z is defined by 

TtA — A TtA — A 
V(Z) = \Ae B : s-lim— exists}, ZA = s-\im— (2.2) 

It is well-known that the converse holds 16,17 - derivatives and integrals being defined 
using the Banach space norm 16 . 

Theorem 2.2 Let T t be a semigroup on a Banach space, s-continuous at t = on a 
Banach subspace B. Define Z by (2.2) (V(Z) ^ 0). Then 

(a) on B, T t is uniquely defined by Z and is s-continuous for t > 0; B is T t -invariant, 
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norm-closed and 



T \ B = I, B = V(Z), ||T t ||<Me at for some M > 1, oeR (2.3) 

(b) Z is a closed operator, for A e 'P(-Z'), 7*^4 is s-differentiable (cf.(2.2)), hence 
T t (P(Z)) C 



and T t A is the unique solution of (2.4) (cf.(l.l')) on B with initial condition A, satisfying 
|| A || < ce kt for c, k constants. 

(c) For A > a (cf.(2.3)) A — Z : V(Z) — > is invertible, its inverse the resolvent of 
Z, is bounded and 



The adjoint semigroup T* is everywhere defined on B* by (T*£)(A) = £(T t A). Sim- 
ilarly since Z is densely defined on B, its adjoint Z* is defined for all £ e S* for which 
A — > £(ZA) is bounded, as the unique bounded extension of this functional to B. Thus 
(Z*£)(A) = £(ZA) \/A e V(Z). Now, unless B is a reflexive Banach space neither T t * 
is s-continuous on B* nor Z* is its generator. Therefore (1.1')) (1-1) are n °t simply 
adjoint equations. However we have 17 

Proposition 2.2 Let T t be a s-continuous semigroup on the Banach space B, with 
generator Z. Then its adjoint T t * is s-continuous on a (presumably proper) Banach 
subspace of B*, uniquely determined on B* by its generator however, and for which Z* 
is an extension. 

Thus going back to (1.1), (1.1'), either Z s or Z* Q can be taken as the generator in the 
evolution equation for the states without any inconsistency. In connection with A 2 we 
require conservation of positivity and of normalization of the states for all times, that 
are indispensable for their probabilistic interpretation 

Assumption (At): (a) For t > 0, £ positive implies T?£ positive; (b) T*£(l) = £(l) for 
any state £. 

By A4 and theorem 2.1 



dT t A 





(2.4) 



dt 




(2.5) 



T t A > for continuous A > in B, 



T t l = 1 



(2.6) 
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which imply 17 that ||T t || = ||T t (l)|| = 1, i.e. T t (hence T*) is a contraction semigroup 

(Pill < 1). 

In summary, assumptions A1-A4, sufficiently well justified upon physical and math- 
ematical considerations, imply that linear autonomous kinetic equations conserving 
the probabilistic interpretation of states, necessarily generate Markov semigroups on 
C(X (X ,G), the space of observables, i.e. a positivity and normalization preserving s- 
continuous semigroup (cf.(2.6)). In the next two sections their properties are considered 
(proof of their 1-1 correspondence with time- homogeneous Markov processes is outlined 
in Appendix 1). 

3. GENERAL RESULTS ON THE GENERATOR 
OF A MARKOV SEMIGROUP 

Here we summarize results on the generator of a Markov semigroup. Though we follow 
mainly Ref.17, some proofs are slightly modified so that a coherent presentation results. 
The Hille-Yosida theorem is in our case 15,17 

Proposition 3.1 A closed, densely defined operator Z on a (presumably complex) 
Banach space B is the generator of a s-continuous contraction semigroup of operators 
iff its resolvent R\ = (A — Z)^ 1 is an everywhere defined bounded operator for A > 
and 

||-Ra|| < 1/A, A>0 (3.1) 

Remark: The resolvent set of Z, i.e. those z G C such that R z is everywhere defined, 
contains 1R + , and since Z is closed, it is an open set, in particular \x belongs there for 
I /j, — A I < jj^-jj . R\ is a closed (hence bounded, by the closed-graph theorem) operator 
on B. 

Contractivity of a semigroup is related to the dissipativity of its generator: by the 
Hahn-Banach theorem, in a normed space B and for every A G B there exists an (in 
general nonunique) i G B* such that 15 

= 1 , £(A) = \\A\\ equivalents = \\A\\ £{A) = \\A\\ 2 (3.2) 

Thus we give: 
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Definition 3.1 An operator Z on a normed space B is dissipative if and only if for 
every (£, A) <E B* x B satisfying (3.2) (Re denoting the real part) 

Re£(ZA)<0 (3.3) 

Remark: For a Hilbert space with scalar product (, ), (3.3) is equivalent to Re (A, ZA) < 
0, hence ||T 4 A|| 2 decreases monotonically in time (cf.(2.4)). This is closely related to an 
if -theorem for the adjoint equation (section 6). 

Proposition 3.2 If Z is a densely defined closed operator on a Banach space B, the 
following are equivalent: 

(a) Z generates a s-continuous contraction semigroup on B. 

(b) (i) Range(A - Z) = B VA > 0, (ii) Z is dissipative 

(c) (i) 3A > : Range(A - Z) = B, (ii) VA e B 3£ e B* so that (3.2), (3.3) hold. 

Proof: (a)=^(b): Condition (b,i) is part of proposition 3.1 Take £, A as in (3.2). Then 
by the continuity of £ and (3.2) 

Re l(ZA) = Re Um mil -mii < Re lim mw-im < 

t^o+ t t^o+ t 

(b) =^(c) trivial 

(c) =*(a) for A E V{Z) take i as in (3.2). Then for any (i > 

\\(jjl-Z)(A)\\ > \l{{ l x-Z)A)\ = \p\\A\-i(ZA)\ > n\\A\ 

hence fi — Z is 1-1 in its range, and if this is equal to B, then \x is in the resolvent set 
of Z and < ^; in particular > A. By the remark in proposition 3.1, every 

H e (0, ^] C (0, A + p^|| ) is in the resolvent set of Z. By induction all fj, E (0, (|) n A] 
are in the resolvent set, for all n G IN. Q.E.D. 
Modifying slightly the proof (c)=>-(a) above we obtain 17 

Corollary 3.1 If Z is a densely defined closable operator on the Banach space B with 
Range(A — Z) dense in B for some A > and condition (c,ii) of proposition 3.2 holds, 
then its closure Z generates a s-continuous semigroup on B. 

Remark: From (2.10-11) conservation of positivity and normalization on C(X QO ,C), 
imply dissipativity. For a partial converse we have 

Proposition 3.3 A s-continuous contraction semigroup T t of operators on C(X 00 , C) 
with generator Z, is positivity-preserving if (ZA)* = ZA*, and 

if A(x ) > A(x) Vx e Xoo then ZA{x ) < (3.4) 



9 



Proof: By proposition 3.1, every A > is in the resolvent set of Z and since T>(R\) = 
C(X 00 , C), we shall show that (X — Z)A > =>- A > 0. Suppose A takes negative values 
on Xqo, with an absolute minimum A(xq). By (3.4) (A — Z)A(xq) < for any A > and 
by proposition 3.1, for any A > ||A(Ai? A --0||<2A VA > 0. Therefore T t x = e - xt e x2R ^ is 
a well-defined, positivity-preserving s-continuous semigroup and \{\R\ — I) — \ZR\. 
From this follows that s-lim A _> +00 A(Ai2,\ — I)A = ZA for A G T>{Z\ which implies 
s-limA^+oo T x = TtA uniformly in t on bounded intervals 17 . Hence T t A > for A > 
Q.E.D. 

Remark: If 1 G V(Z), (3.4) implies Z(l) = 0, hence T t l = 1. 

Proposition 3.2 and theorem A. 1.1 give the characterization of the generator of a Markov 
semigroup by (see Ref.34, section 7.7 for a slightly different formulation) 

Theorem 3.1 Let Z be a densely defined closed operator on C(X QO ,G). Then the 
following are equivalent: 

(a) Z generates a Markov semigroup T t 

(b) (i) 1 G V(Z), 

(ii) 3A > : Range(A - Z) = C^X^, <D), 
(hi) (ZA)* = ZA* \/A G V(Z), 
(iv) (3.4) holds. 

Proof: (a) =^ (b). (i) follows from (2.6), (ii) from proposition 3.1 since T t is a contrac- 
tion semigroup. By theorem A. 1.1 and (A. 1.2) both (hi), (iv) are evident, 
(b) =^ (a). Let A G T>(Z). Since X^ is compact, \A\ continuous, \\A\\ = \A(x )\ for 
some x G X^. Without loss of generality let A(x ) > and 5 X0 be the 5-function at 
x , which is a positive linear functional on C(X OQ , C), hence ||5 X0 || = S xo (l) = 1. Then 
|| A|| = A(x ) = 5 X0 (A) > A(x) Wx G X^, so that by (3.4) 5 Xo (ZA) = ZA(x ) < 0. 
Hence by (ii) and proposition 3.2, Z generates a contraction semigroup, which by (ii), 
(hi) and proposition 3.3 is positivity-preserving. Since T>(Z) 3 1, T t l = 1 by the remark 
to proposition 3.3. Q.E.D. 

Remark: Proposition 3.3 and theorem 3.1 show that (3.4) is the crucial condition 
relating dissipativity with conservation of positivity (see end of section 4 and section 6). 
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4. DIFFERENTIAL OPERATORS GENERATING 
MARKOV SEMIGROUPS 



In view of the last remark we explicit the form of the generator of a Markov semigroup 
that is a differential operator, since kinetic equations are often given by such operators. 
We first prove 18,19 

Lemma 4.1 Let Z be a differential operator of order k, defined on C fc (R n ,R) and 
suppose that for any / G T>(Z), if f(x ) > f(x) Wx G R n then Zf(x ) < 0. Then Z is 
at most a 2nd order differential operator with nonegative-definite 2nd order coefficient. 
Proof: (i) Let n — 1. By the remark to proposition 3.3, Z has no zeroth order term. 
Suppose Z has the form 

Z = c 1 (x)± + c 2 (x)^ + c k (x)^ k>3 

and that Ck(xo) ^ for some xo G R. Let 

g(x) = —e(x — x ) 2 + a(x — x ) k , e > 0, aGR 

Clearly g has a local maximum zero at xo- There is a neighborhood N(xo) with compact 
closure, in which g(x) < g(xo) = 0. Let f(x) be a C fc -function with compact support, 
f(x) < on R — N(xq) having the same partial derivatives with g up to order k, on 
the boundary of N(x ). Then 



g(x) , x G N(x ) 
fix) , x G R - N{x ) 



is a C fc -function with f(x) < f(x ) = \/x G R and Zf(x ) = — 2ec 2 (a;o) + k\ack(x ). 

Since k > 2, appropriate choice of a, makes it positive, unless Ck(xo) = 0. 

By a similar argument C2(x) > Wx G R (for any take g(rc) = — e(x — x ) 2 , e > 

0). 

(ii) For n > 1 let Z contain a term of the form c(x)d^d^ ...d^ , where ai + a 2 + ... + ae = 
k > 2 and $ = ^. The proof can be repeated, starting with a :ro for which c(xo) 7^ 
and 

g(x) = a(x^ - x* 1 ) 01 ...^ - 4T " 4) 2 

i=i 

since it has a local maximum at x . With g{x) = — Yhj=i \^j( xl ~ x o)( x ^~ x o)i ^« e ^5 
proceeding as before we obtain Zf(x ) = —J2i t j=i a ij( x o)\^j < where is the 2nd 
order coefficient of Z. Q.E.D. 
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Remark: The proof above is local. Therefore working in some local coordinates of a 
differentiable manifold and using its local compactness, so that N(xo), hence / above 
exist, the same proof holds. 

Now C 2 (R n ) C C(R^ G ), with the identification of continuous functions of R n having 
a finite limit at oo with elements of C(R^ ) made in section 2. Then the following 
theorem supplies a sufficient condition for the generator of a markov semigroup to be 
a differential operator 20 . 

Theorem 4.1 Let T t be a Markov semigroup on C(R^,C) with generator Z and 
suppose that 

(i) C C 2 (R") C V{Z) 

(ii) The transition probability measure p(t,x,-) of the corresponding Markov process 
(see appendix 1) satisfies 

lirn ^ ' ^ — ~ = Xn(x) uniformily in x (4.1) 

Then 

Zf{x)=b l {x)d t f{x) + a t3 {x)d l d J f{x) feC 2 (H n ) (4.2) 

bi, dij are continuous, real-valued functions, is a nonegative-definite matrix \/x G R ra , 
Xn is the characteristic function of N and the summation convention is henceforth 
assumed. 

Proof: Let xq G R n , and for / G C 2 (R n ) consider its 2nd order Taylor polynomial 
at x~o, denoting by f(x) the corresponding remainder. By Taylor's theorem, for every 
e > 0, f(x) < e 1 1 a? — a? 1| 2 m some neighborhood N(x ). Put 



e 1 1 af — af 1 1 2 , x E N(x ) 
a(x) , fGR^-TV(fo) 



where a(x) G C 2 (R n ) is nonnegative and it and its first two partial derivatives coincide 
with those of / on dN(x ) (without loss of generality we take N(x ) compact). Then 
1/0*01 < e 9e(x), % e N(xo) an d 

\ z fM\ = lim |y / f(y)p(t,x ,dy) + - [ f(y)p(t,x ,dy)\ 

t^0+ t Jn^-Nixo) t Jn{x ) 

By (4- 1 ) If Ik™ -n(s ) f(y)p(t,x ,dy)\ < ||/||o(l). On the other hand, since g e > 
t iW(xo) f(y)p(ti ^0) ^Z/) < f / 9e(y)p(t,x ,dy). Therefore |Z/(f )| < cZg e (x ). But e is 
arbitrary, hence Zf(x ) = 0. 
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Considering the functions f l {x) = x % — x l , f l ^{x) = (x l — x l ){x^ — x 3 Q ) in N(xo), extended 
to C 2 (R n )-functions and using (4.1) we get 



Zf\x)= lim l 1 f pfaZdjMy'-j) 

t->0+ t JN(xn) 



t-+0+ t Jn(x ) 

Zf ij = lim \ f pit, x, dy) [y i - x i ){y j - x j ) 

t^0+ t JN(x ) 

Returning to / and using this and that Z(l) = 0, we obtain Zf(x ) = 0. Since x is 
arbitrary, (4.2) follows with bi(x) = Zf l (x), = \Zj l \x). By the definition of Z, 
bi,ciij are continuous and evidently aij{x) is nonegative-definite. Q.E.D. 

Remarks: 

(a) Eq(4.1) implies the existence of the first two moments of p(t,x, ■) and Lemma 4.1 
that all higher moments vanish 21 . Notice that in the theory of stochastic processes, 
(4.2) is usually derived by assuming (4.1) and the existence of the first two moments of 
p, from which the vanishing of higher moments follows 5 . Notice also that (4.1) implies 
uniform stochastic continuity of p(t,x,N), (A. 1.3). 

(b) For arbitrary differentiable manifolds, theorem 4.2 holds, since only local compact- 
ness of IR™ and Taylor's theorem are used. 

(c) The theorem is true if IR™, R^, are replaced by U, U, where U G R n is a relatively 
compact open set, i.e. U is compact. 

Theorem 4.1 shows that (4.1) is a rather strong condition. It should be desirable to 
have a characterization of the generator of a Markov semigroup relaxing (4.1), namely 
operators satisfying (3.4) 22 . In this connection the following remarks are relevant: it 
can be shown that a necessary and sufficient condition for a linear operator acting on 
C 2 - functions and for which Z(l) = 0, is a 2nd order differential operator, is that for 
any A in its domain and x such that A(x ) = 0, it follows that Z(A 3 )(x ) = 23 . On 
the other hand, (3.4) implies that for all nonpositive functions Z(A 3 )(x ) < whenever 
A(x ) = 0. Therefore in theorem 4.1 the equality-sign case is characterized. To put it 
differently : generators of Markov semigroups that are not only differential operators, 
are characterized by the condition that there exist nonpositive functions A for which 

Z{A 3 ){x ) < when A(x ) = 

Thus the problem reduces to the characterization of such operators. 
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5. DEGENERATE ELLIPTIC EQUATIONS AND MARKOV 

SEMIGROUPS 



In the previous section we have shown that the generator of a Markov semigroup is a 
2nd order differential operator if it is defined for C 2 -functions and satisfies (4-1)- On 
the other hand, as mentioned in section 1, various approaches to kinetic theory that 
starting from microscopic classical dynamics and imposing more or less systematic ap- 
proximation schemes, lead to linear autonomous kinetic equations for particular classes 
of systems that are partial differential equations (see e.g. the approaches based on it- 
eration schemes applied to the so-called generalized master equation of one or another 
form 2-4 ). Therefore they are incompatible with A 1 — unless they are at most of the 
2nd order with nonegative- definite leading coefficient. 

Using the results of section 4 we shall show that under quite general conditions, the 
converse is true, namely an operator of the form (4-2) generates a Markov semigroup 
on observables globally defined on the phase space. Moreover conservation of positivity 
is essentially equivalent to the existence of an if-theorem for the adjoint semigroup. 
This is the subject of the next section. We consider R n , but our results are applicable 
to any differentiable manifold, without essential modifications, since they depend on 
local differentiability properties of function of R n and its local compactness. 



C 2 (R^, C) = {/ G C 2 (R", C) : /, dif, didjf have a finite limit at infinity} (5.1) 

(cf. the comments following A 1 in section 2), hence C 2 (R^ C , C) is identified with a subset 
of C(R£,,<D); C k (H^,<D) is defined similarly. These are dense subsets of C(R£,,<D), 
noticing that for any x G R^,, and 



/ is in C fc (R^ C) , C) and f(xo) ^ f(x) if x® ^ x and using the Stone- Weierstrass theorem. 
Definition 5.1 The operator Z : C 2 (R^, C) -> C(R^, C) is defined by 



where a^, bi G C(R^ , C). Here and in what follows the summation convention is used. 
By the above discussion Z is densely defined. We next prove 



We define 




(5.2) 



Zf(x) = aiji^didjfix) + bi(x)dif(x) 



(5.3) 
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Proposition 5.1 Z in (5.3) is closable. 

Proof: (i) It is sufficient that if lim n ^ +00 ||/ n || = for f n G T>(Z) and there exists g 
such that lim^+oo \\Zf n — g\\ =0 then g = 15 . Let a^, bi be in C 2 (R^ , C) and take 
Po e C 2 (R^, C) with 

p Q (x) > 0, Jim p (x) = Jim dip (x) = 0, / p (x)dp(x) = 1 (5.4) 

where /x is the Lebesgue measure of R™. Clearly p has the form 

p (x) = cexp(-(3H(x)) cJeR + (5.4') 

and 

~p : p(E) = / Po {x)dp{x) (5.4") 

defines a measure on R n , extended to a regular measure on R^ by putting p(t, x, oo) = 
0. By (5.4)and Lemma 5.1 below 

V(Z), Range(Z) C C(B£, C) C L^(R^) C L 2 (R^) C Lj(R^) (5.5) 

each L~-space equipped with the usual || || p norm, p < +oo. 

(ii) Let <p G V(Z) with compact support tt. Using (5.4) and (5.4'), integration by parts 
gives 

J <fr*Zf n dp = J fnldidjiaijpo^*) - di(b iPo (f)*)]dp = J f n Z j (p (f)*)dp (5.6) 

Z\<p Po ) = po(Z0-2(/3a^F-9 j a ij +6 l )9 l 0) + 0Z t po = po(Z<£-iW) + <P^p (5.7) 
Z^ being the formal adjoint of Z. Therefore, by (5.4) 

| j <t>*gdp\<\\Zf n -g\\ ||0|| 1 + | J^ZUdpl^O 

Thus J(f)*gdp = for <p G C 2 (R n , C) which is dense in C c (R n , C). Therefore the result 
follows by the continuity of || H2 and Lemma 5.2 below. 

(iii) For arbitrary , 6, in C(R^ G , C) and e > there exist functions dij, hi G C 2 (R^ CJ , C) 
such that ||<2jj — Oy|| < e, ||Sj — < e. Defining Z by (5.3) in terms of d^, bi we get 

I / (f>*Zf n d~p\ < e||0||(||^/ n || + \\djj) + U\\\\Zfn\\ Ve > 

for any <fi G C 2 (R^, C) and we proceed as before. Q.E.D. 
Lemma 5.1 If (X,B, p) is a measure space with p(X) = 1 then for any / in L~°(X) we 
have < 11/11, V < p < q < 00 hence (L?(X), || || ? ) C (L?(X), || || p ) in a natural 

14 

way 
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Lemma 5.2 If / G C(R n , C), jl is a finite measure on R n and for any G C c (R n , C) 
/ f(x)(f)(x)djl(x) = 0, then / = 0. 

Proposition 5.1 holds if R n , R^, are replaced by £/, [7 respectively for any relatively 
compact open {7 C ]R n . Obviously (5.4') has to be modified. Therefore, let Zjj be the 
restriction of Z in (5.3) on U for any relatively compact open U C R n , and its 
closure, easily seen to be the restriction of Z on U. Then we have: 

Proposition 5.2 Suppose that for Z in (5.3), a^, 6j are in C 2 (R n , R), is a nonegative 
- definite matrix and d^dn^ij are Holder continuous for some positive exponent 24 . Then 
there is a (topological) base of relatively compact (open) sets {U a } and a A > such 
that for each U a Range(A — Z a ) = C(U a , C), where Z a = Zjj a . 

The proof 25 uses the generalization of classical results concerning the solution of 
elliptic equations with strictly positive-definite 2nd order coefficient, bounded from 
below away from zero 26 , at the expense of requiring the coefficients to be C 2 -functions 27 . 
Relaxing the restriction of strict positivity of (a^) is important for kinetic theory, given 
that it is violated by important kinetic equations (e.g. the (linear) Landau equation 
either in phase-space or velocity space, or model equations like Kramers equation 2 ' 6,7 ), 
whereas regularity conditions are not so essential, since sufficient differentiability is 
often implicitly required. 

In the above notation, let / G C(R n , C) and f a = f\u a - Then there exists a unique 
u a E V(Z a ) with (A - Z a )u a = f a , hence Range(A - Z a ) = C(U a ,€). Proceeding 
as in the proof of theorem 3.1, condition (cii) of proposition 3.2 is equivalent to the 
nonegative-definiteness of in (5.3). By Corollary 3.1, Z a is the (dissipative) generator 
of a s-continuous contraction semigroup on C(U a ,G). Since (Zf)* = Zf*, and 1 e 
V(Z a ), by theorem 4.1 Z a uniquely defines a Markov semigroup on C(U a , C). Restricting 
it on C(U a , C), T t a say, we define (T t f)(x) = (T t a f)(x) V x G U a for / e C(R n , C) 

By the uniqueness of T t a , T t is well-defined, positivity preserving and since U a is 
open, T t f is continuous. Then for / G C c (R ra , C), its support can be covered by a finite 
subset of {U a }, U\, • • • ,U n say, and support(T t /) C support(/), since on each U a , T t a is 
a Markov semigroup. Therefore 

|T t /(f)| <max{||T t fc /||, k = 1, 2, • • • , n} < \\f\\ 

hence T t is bounded. By the remark to theorem 2.1, any i in (C c (R n , C))* is biuniquely 
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defined by a finite measure /i, so that 

n „ n 

em -/)<£/ d^)\T t k m - f(x)\ < /i(iR«) x: iir t fe / - /ii 
k=i jUk k=i 

Thus T t is w-continuous at t — 0, hence s-continuous for all t > 0. Therefore T 4 is 
uniquely extended to C (R n , C) since C c (R n , C) is dense there 14 , preserving the above 
properties (this extension is also denoted by T t ). As in the proof of theorem A. 1.1, we 
show that T t satisfies (A. 2.1) for some probability measure p(t,x,-) on R n , regularly 
extended on R^ by putting p(t, x, {oo}) = 0. Thus T t is a Markov semigroup on 
C(R^ D , C) with generator locally given by the closure of Z in (5.3). This completes the 
proof of 

Theorem 5.1 Z in (5.3) is a densely defined, closable operator on C(R^, (D). Its closure 
Z generates a Markov semigroup T t on C(R^ CJ , C) if (a^) is a nonegative-definite matrix 
function, ay,6j are in C 2 (R n ,R) and d^d^a^ are Holder continuous for some exponent 
in (0,1). 

Remark: Theorem 5.1 is valid without essential modifications on any different iable 
manifold, in particular for a relatively compact open subset of R^, (see the remark 
preceding proposition 5.2). 



6. THE //-THEOREM AND CONCLUDING REMARKS 

In this section we consider arbitrary Markov semigroups on C(R^ C , C), the generator 
of which is not necessarily a differential operator. We shall prove that the adjoint 
semigroup giving the evolution of states, satisfies a general H-theorem. Working with 
the adjoint semigroup, the proof turns out to be simpler and the theorem more general 
than that obtained directly from the kinetic equation. We introduce the measure \x 
defined by (5.4"). Then any G C(R^, C) (or G L^(R^) !) defines a bounded linear 
functional 1$ on C(R^, C) via 

e^A) = J A(x)<j)(x)djl(x) (6.1) 

If T t is a Markov semigroup then by theorem A. 1.1 and Fubini's theorem 14,28 , to T^i^ 
corresponds uniquely the measure (cf. (A. 1.4)). 

is t (E) = J p(t,y,E)<j>(y)dm , (T t %)(A) = J A(x)du t (x) (6.2) 
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and we have the following 

Theorem 6.1 (//-Theorem) Let T t be a Markov semigroup on C(R^ G , (0), with cor- 
responding Markov process p(t, x, E). If 

p(t,x,E) = q(t,x,y)dp(y) (6.3) 
Je 

where q(t, •, •) is jointly Borel measurable, and p is an invariant measure of p(t,x,E), 
i.e. 

Jp(t,x,E)dp(x)=p(E) (6.4) 
Then for any positive G C(R^, C), T t *^, is defined uniquely by the density 

<t>t{x) = J q(t,y,x)(f)(y)dp(y) (6.5) 

For any convex function h : R + — > R and all nonegative G C^R^,, C), with h o 
/2-integrable, 




is a decreasing function (//-function) 29 . 

Proof: (6.5) follows from (6.2), (6.3). For the second assertion we use Jensens' 
inequality 14 ' 30 . Since q(t,-,x) is /i-integrable, E — > J E q(t,y,x)dp(y) defines a mea- 
sure on R n , with a finite total measure which by (6.3), (6.4) is / q(t,y,x)dp,(y) = po(x) 
31 . Since q, are nonegative, Jensen's inequality and (6.5) give 

h ( f q (t,y,x)m \ =h (hm<( sM£wm dm 

\J po{x) J \Po{x)J J po{x) 

Therefore by / q(t, y, x)dp(x) = p(t, y, R^) = 1 

/" £i) dm - /^®»® - S h (Wi) ] '=° dm 

and since p(0,x,E) = Xe(x) by (6.3), q(0,x,y) = 5(x — y) (cf. remark (b) to theorem 
A. 1.1). Thus H(t) < //(0). If t = S t (f> then by (6.5) and (A. 1.1), (6.3) implies the 
semigroup property for S t , hence applying the above result to <f> t for any s > we have 

H(t + . ) = j h ^)«<j h (%)« = m 

Q.E.D. 
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Remarks: 

(a) Equation (6.4) is equivalent to T^i\ = t\ (c.f. (6.1)) 

(b) When T t is a stochastic matrix semigroup T nm (t) with Z) n T nm (t) = 1, the H- 
theorem holds with the substitutions 

0(f) < ► p n , <p t (x) < > T nm(t)p m = p n (t) 

m 

Po(x) < ► VT„ = Y, T nm(t)n m , / ( )dp(x) < ► ^( )lT m 

rn m 

The essential condition for the H -theorem is (6.4) 32 - To clarify its meaning we go back 
to diffusion-type Markov semigroups and notice that if a^, biEV(Z), use of (5.4), (5.6), 
(5.7), (6.1) implies that under the assumptions of theorem 5.1 and for any / G T>(Z) 

t^Zf) = f{Z<j>- HA^fdjl + J f^podfjL (6.7) 

Suppose that Z^p = 0. By (6.7) / — > i^iZj) is bounded hence it can be uniquely 
extended to (7(11^, C) and therefore it belongs to V(Z*), and 

(Z%)(f) = J Z\p^)jdp V / G V{Z) (6.8) 

Since V(Z) is dense, (Z)* = Z\ hence ^ G X>((Z)*). Finally (6.8) can be applied 
to = 1 and therefore Z^po = is equivalent to \x being an invariant measure of the 
Markov process corresponding to T t . But it is easily seen that T^l^ is s-continuous, 
hence using theorem 2.1, equation (2.4), we complete the proof of 

Proposition 6.1 If a^fr; in (5.3) are in V(Z) and p m (5.4) is annuled by 

Z ] = diiaijdi + (djOij - b t )) (6.9) 

Z^po = (6.10) 
then (i) any G C 2 (R^, C) defines an ^ G V(Z*) via (6.1) and 

jT;^ = (zyr;^ = z*t,% (6.11) 

(ii) jx in (5.4") is an invariant measure of the corresponding Markov process. 

(iii) If (6.3) holds and q(t,x, •) is a C 2 -function for t > 0, then (cf.(6.5)) satisfies 

^ = Ztfc (6.12) 
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Proof: The first two assertions have already been proved. For (6.12), we notice that 

by (6.2), (6.5), (6.11), 

to / ( *(*)-*■(*> - ZV, (*)) = 

uniformly in A e C c (R n ,C). For x G R n we take / e C c (R n , C) nonegative, suf- 
ficiently differentiable with f(x ) > and A n (x) a (^-sequence of C°°-functions. If 
t n —> to as n +oo, applying the above equation to A n (x)f(x), written as 

lim / f(x)G n (x)A m (x)dp,(x) = 

we can show from the uniform convergence with respect to m of this double sequence, 
that lim n ^ +00 G n (x ) = 0, i.e. (6.12) holds. Q.E.D. 

Remark: In the formalism of Refs. 6, 7 H { in (5.7) is zero (equation (2.19) of Ref.7 and 
the discussion following it). By (5.7), (6.9), (5,4') this implies (6.10). The essential 
content of this proposition is that the existence of an invariant measure fx, hence of an 
H -theorem, is supplied by the existence of an equilibrium distribution satisfying (5.4). 
Physically speaking, this may be interpreted as the stationarity of a Maxwell-Boltzmann 
(MB) distribution for the formal adjoint equation (6.12), if H in (5.4') is nonegative. 

At this point however it should be noticed that although the existence of a stationary 
solution of (6.12) is not a strong requirement, on the contrary, it is a physically desirable 
feature of classical kinetic equations, its Lebesgue integrability (see (5.4)), is a constraint 
violated by quite simple evolution equations and for which a differential form of an H- 
theorem is nevertheless easily proved (cf. (6.14) below and the discussion following it). 
Think for instance of the diffusion equation, even with variable coefficients, for which 
Po(x) = 1 (see also appendix 2). Therefore, one is tempted to relax (5.4) and keep only 
the stationarity of p . Then, a careful reconsideration of the proofs of theorem 6.1 and 
proposition 6.1 shows that minor modifications in their hypotheses ensure their validity 
in this case as well. This is the content of 

Corollary 6.1 With the notation of theorem 6.1 and proposition 6.1, suppose p 
is a nonegative, C 2 -function, bounded at infinity (or on the boundary of a relatively 
compact subset of R™ - cf. remark to theorem 5.1) together with its first derivatives, 
satisfying (6.10); in (6.5) has compact support; h(0) = for h in (6.6). 
Then, (6.12) is valid and (6.4) holds locally, i.e. 

J V(t, V, x) p (y)dfi(y) = p (x) (6.4') 
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from which the H-theorem follows (cf.(6.6)). 

We may use proposition 6.2 to get an instructive, albeit more special, differential 
form of the H-theorem : If h is twice differentiable, then by (6.12), at least formally 

= / ti(4> t )Z^0 tPo )dv (6.13) 

where 4> t = 4>t/ 'po, h'(y) = dh/dy. Using (5.7), (6.10) directly and in the form 
/ h(4>t)Z^podp, = we find after a straightforward but lengthy calculation, 

dH r 

~dt = ~ J Poi^tWi^aijO^tdj^tdp (6.14) 

under the assumption 

(poaijdjhfa) + /i(^)#i)loo = (6.15) 

(for instance if h is a C 1 -function with h(0) = 0, e.g. h(x) = x 2 ). 

Since h" > 0, the H-theorem holds if and only if is a nonnegative- definite matrix 
(cf. proposition 4.3 of Ref.6; for stochastic matrices see Ref.2 section V.5). This shows 
explicitly the close connection between conservation of positivity (cf. (3.4), (5.3)) and 
the existence of H -functions, though theorem 6.1 is more general. In view of the 
remark to proposition 6.1 and apart from regularity conditions on the coefficients of 
the generator Z, equation (5.3), such an operator having a nonegative- definite second 
order coefficient, leads to a satisfactory kinetic description (cf. end of section 2) in 
the sense that it defines a Markov semigroup satisfying a general H-theorem, once the 
existence of a bounded at infinity equilibrium solution (possibly of the MB-type) for its 
formal adjoint has been assured. As a final remark, notice that by the above discussion 
(cf.(6.14)), such a solution ensures that the Markov semigroup property is equivalent to 
the existence of H- functions (cf. in this respect Refs.33). 

As already mentioned, this follows if Hi = 0, equation (5.7), which is valid in the for- 
malism developed in Refs.6, 7 thus proving that the latter provides a satisfactory kinetic 
description for open systems interacting with large baths at canonical equilibrium. 

Acknowledgement: This work has been partly supported by the Euratom Fusion 
Programm. 
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APPENDIX 1 



The characterization of Markov semigroups in terms of Markov processes is well- 
known, but proofs are often incomplete or different because of differences in the defini- 
tion of a Markov process. Here we use 

Definition A. 1.1 Let M be a compact topological space, and B its Borel a-algebra. 
Then a (time homogeneous) Markov process on M is a function p : R + x M x B — ► R 
such that 

(i) p(t,x, •) is a probability measure 

(ii) p(t, - ,E) is a Borel function 
(iii) 

p(t + s,x,E) = J p(t, x, dy)p(s, y, E) (Al.l) 

For any / G C(M, C) 

T t f(x) = fp(t,x,dy)f(y) (A1.2) 
is continuous. The process is called uniformly stochastically continuous if 16 

lim p(t,x,E) = 1 uniformily in x G E (A 1.3) 

p— >o+ 



T t is called a Feller semigroup and we have the following theorem 34,35 used in the proof 
of theorems 3.1, 4.1 

Theorem A. 1.1 Uniformly stochastically continuous Markov processes on M are in 
1-1 correspondence with s-continuous Markov semigroups on C(M, (D), the latter being 
equipped with the supremum norm. 

Outline of proof: (=>■) It is easily shown that (A. 1.2) defines a positivity and nor- 
malization preserving semigroup. By a standard argument, uniformity of the limit in 
(A. 1.3) implies s-continuity of T t . 

(<=) Let T t be a Markov semigroup on C(M, ©). For each x G M, t > 

£:C(M,C)^C: £(f) = T t f(x) 

is a positive (hence bounded) linear functional on C(M, C). By (2.6) and theorem 
2.1 there exists a unique probability measure p(t,x, •) such that (A. 1.2) holds. (A. 1.1) 
follows from the uniqueness of p(t, x, •) and the semigroup property of T t . Condition (ii) 
is proved by using for every compact or open E, a monotonic sequence of continuous 
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functions /„, converging pointwise to xe 28 to show that lim n ^ +00 T t f n (x) = p(t,x,E), 
so that condition (ii) holds for such E. Then taking account of the regularity of p 14 , 
this result is extended to all Borel sets. (A. 1.3) is proved by taking for every Borel set 
E and x G E, an / G C(M, R) vanishing outside E, and f(x) > 0, and consider the 
continuous function 

, , _ J i, /(v) > /(*) 
lip /(*)</(*) 

for which < g(y) < 1 for all y such that f(y) > 0. Then it is easily shown that 
g(x) - T t g(x) > 1 - p(t, x, E) and (A.1.3) follows by the s-continuity of T t . Q.E.D. 

Remarks: (a) It can be shown 34 that by the compactness of M, pointwise convergence in 
(A.1.3) is equivalent to uniform stochastic continuity, based on the fact that pointwise 
convergence of T t for t = is equivalent to w-continuity for t — 0. 

(b) Using (2.3) and the regularity of p(0,x, •), we get p(0,x,E) = Xe{x) for any Borel 
set E. 

(c) For every (positive and/or probability) measure v defining uniquely t G C*(M, C), 
Tj*£ is uniquely specified by the (positive and/or probability) measure 

is t (E) = J p{t,x,E)dv{x) (A1.4) 



APPENDIX 2 

Here we present one-dimensional examples of Markov semigroups, for which a non- 
integrable equilibrium solution p , satisfying (6.10) exists, but which nevertheless satisfy 
the requirements of corollary 6.1, hence they obey a global H-theorem (for their physical 
interepretation see ref.36) 

(a) ZA=(1 + x 2 )d 2 x A - (2a - l)xd x A x G R, a > -1/2 

(b) ZA = x 2 d 2 x A + (1 - (2a - l)x)d x A x > 0, a > -1/2 

The corresponding (unnormalized) equilibrium solution p of their formal adjoints are 
respectively 

p Q = (1 + x 2 )-^/ 2 ) , Po (x) = x-^e- 1 /* 

(notice that Hi in (5.7) vanishes identically - cf. remark to proposition 6.1). It can 
be shown that for —1/2 < a < 0, these solutions are not integrable, although they 
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satisfy the conditions of corollary 6.1, hence the corresponding semigroups satisfy an 
H-theorem in the sense of theorem 6.1. Notice that when the phase space is not R^,, as 
in (b) above, the results of section 6 are still valid provided we replace any conditions 
imposed at infinity, with the same conditions on the boundary of the phase space. 
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